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^ This paper, together with a preceding paper, questions the so-called 'LSND anomaly' : a 

(]j 3.8 (J excess of interactions over standard backgrounds, observed by the LSND Collabo- 

Q ration in a beam dump experiment with 800 MeV protons. That excess has been interpreted 

as evidence for the oscillation in the Am^ range from 0.2 eV^ to 2 eV^. Such a 

Am^ range is incompatible with the widely accepted model of oscillations between three 
^ light neutrino species and would require the existence of at least one light 'sterile' neutrino. 

1^ In a preceding paper, it was concluded that the estimates of standard backgrounds must be 

significantly increased. In this paper, the LSND Collaboration's estimate of the number 
of Ve interactions followed by neutron capture, and of its error, is questioned. The overall 
conclusion is that the significance of the 'LSND anomaly' is not larger than 2.3 a. 
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1 Introduction 

This is the second of two papers that argue that the 3.8 a significance of the 'LSND anomaly', 
claimed by the LSND Collaboration, cannot be upheld. 

The LSND experiment was carried out at the Los Alamos National Laboratory in the years 
1993-1998. Its scientific goal was a search for — )■ oscillations in the 'appearance' mode. 
The neutrino fluxes were produced by dumping 800 MeV protons into a 'beam stop'. While u^, 
and z^c fluxes were abundant, the flux was vanishingly small. 

The LSND Collaboration claimed an excess of interactions over the expectation from 
standard backgrounds [[T|. This excess was interpreted as evidence for the z/^ — )■ Ue oscillation 
with Arv? in the range from 0.2 eV^ to 2 eV^ and came to be known as 'LSND anomaly'. In 
stark conflict with the widely accepted model of oscillations of three light neutrino flavours, the 
excess would require the existence of at least one light 'sterile' neutrino that does not couple to 
the Z boson. 

Since the 'LSND anomaly' calls the Standard Model of particle physics in a non-trivial way 
into question, the MiniBooNE experiment at the Fermi National Accelerator Laboratory set out 
to check this result. In the neutrino mode, an oscillation — )• Uc with parameters compatible 
with the LSND claim was not seen [2|. However, first results from running in antineutrino mode 
and searching for — )• led the MiniBooNE Collaboration to conclude that their result does 
not rule out the 'LSND anomaly' ||3| that had indeed been observed in the antineutrino mode. 

In this situation it appears worthwhile to undertake a critical review of the original results 
of the LSND experiment that gave rise to the 'LSND anomaly'. This is the subject both of this 
paper and of a preceding paper Q. 

Although we agree with many of the LSND Collaboration's approaches and results, in two 
areas we disagree with LSND. The first area — which has been discussed in Ref. [4] — concerns 
the underestimation of the z/g flux from standard sources. According to our assessment the in- 
creased standard background reduces the significance of the 'LSND anomaly' from 3.8 to 2.9 a. 
The second area is quantitatively discussed in this paper. It concerns the neglect of a bias and 
the underestimation of systematic errors in the isolation of the signal of ~120 z/e + P — ^ + n 
reactions with a correlated 7 from neutron capture out of ~2100 candidate events. 

2 The LSND fit of the distribution 

In this section, we recall LSND's determination of the number of beam-related Uc interactions 
by a fit to the distribution — the centre piece of the LSND data analysis. Before, we describe 
briefly the salient features of the LSND experiment. 

The LSND neutrino detector [5] is a tank filled with liquid scintillator. The amplitude and 
the time of arrival of scintillation light and of Cherenkov light are detected by an array of 
phototubes (PMTs) on the surfaces of the tank. The reconstruction of the energy and position of 
reaction secondaries is solely based on the responses of the phototubes. There is no distinction 
between positive and negative electric charges. 

The z^c flux is measured through the reaction z/c + p — t- e+ + n which has a well known cross- 
section. The signature is an e+ and a delayed 2.2 MeV 7 from deuteron creation by the capture 
of the neutron on a free proton, n + p ^ d + j. The average delay of the 7 is ~186 /iS, 
determined by the neutron capture cross-section in the scintillator medium. 

Besides cuts that enrich beam-induced electrons^) w.r.t. cosmic-ray particles, and a cut that 
requires electrons to be inside a fiducial volume that ends 35 cm from the faces of the PMTs, 

use the generic term 'electron' both for electrons and positrons. 
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a cut 20 MeV < i^c < 60 MeV^^ is applied to qualify as 'primary electron'. Furthermore, 
activities within 1 ms after the primary electron are recorded with a lower trigger threshold not 
to miss 2.2 MeV 7's. The number of such activities can be zero, one, or larger than one. 

Despite the cuts to suppress cosmic -ray particles, there remains a large cosmogenic back- 
ground. This background is determined in beam-off gates and subtracted after proper normal- 
ization from the event numbers observed in beam-on gates. This doubles approximately the 
statistical error but introduces no systematic uncertainty. 

Integrated over the data taking of the LSND experiment in the years 1993 - 1998, the num- 
ber of beam-related 'primary electrons' is about 2100. The key issue is how to isolate from 
these 2100 events the signal, i.e., the number of events with a correlated 2.2 MeV 7 from neu- 
tron capture. We recall that the signal claimed by LSND is 117.9 events fP\. 

The isolation criterion applied by LSND is the following. "Correlated 2.2 MeV 7 from 
neutron capture are distinguished from accidental 7 from radioactivity by use of the likelihood 
ratio, R^, which is defined to be the likelihood that the 7 is correlated divided by the likelihood 
that the 7 is accidental. Rj depends on three quantities: the number of hit PMTs associated with 
the 7 (the multiplicity is proportional to the 7 energy), the distance between the reconstructed 7 
position and positron position, and the time interval between the 7 and positron (neutrons have 
a capture time in mineral oil of 186 /is, while the accidental 7 are uniform in time)" (Section 
VILC in Ref. Q). 

The said likelihoods for correlated and accidental 7's are obtained from respective distribu- 
tions of hit PMTs, distance and time interval that are shown in Fig. lOofRef. [1] and reproduced 
here in Fig.[T] In the following, we refer to these distributions as 'base distributions'. An activity 
within 1 ms after the primary electron is only accepted if three criteria are met: Ar < 250 cm, 
8 /iS < At < 1 ms, and 21 < Nhns < 60. If all three criteria are met, the product of the 
probabilities of the observed Ar, At and A^hits is calculated both for the correlated and the ac- 
cidental distributions, and then their ratio R^. If at least one of the three criteria is not met, the 
likelihood ratio R^ is artificially set to zero'^^ If there are several accepted activities, the activity 
with the largest R^ is chosen (Section III.F in Ref. Q). The resulting Ry distribution of the 
data is shown as black dots with (statistical) error bars in Fig. 14 in Ref. [[T|, reproduced here in 
Fig. a 

The prominent peak of the R^ distribution in the first bin reflects the many events with no 
accepted activity within 1 ms after the primary electron. 

The Ry distribution of the data is then fitted with a linear combination of two R^ hypotheses: 
the normalized R^ distribution of correlated 7's and the normalized Rj distribution of accidental 
7's. The former is obtained by generating triplets [Ar, At, A^hits] according to the respective 
distributions for correlated 7's, and then calculating Rj. The latter is analogously obtained by 
generating triplets [Ar, At, Ahits] according to the respective distributions for accidental 7's, 
and then calculating R^. By construction, the Ry distribution of correlated 7's favours large 
values of Ry while the Ry distribution of accidental 7's favours small values of Ry. In addition, 
for either hypothesis an estimate was made of the probability of meeting all three criteria on 
Ar, At and A^^its (termed 'efficiency' by LSND). 

Then, according to LSND, a minimization determines a signal (termed 'beam excess' by 
LSND) of 117.9 ± 22.4 events with a correlated 7 out of about 2100 candidate events (Section 
VII.D in Ref. Q). 

^^The maximum energy of a in the decay of a muon at rest is 52.8 MeV. 

^^LSND make no statement about lower and upper limits of Ry-, in our analysis values of Ry below 0.051 are 
set to 0.051, and values above 199 are set to 199. 
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Fig. 1: "Distributions for correlated 2.2 MeV 7 (solid curves) and accidental 7 (dashed curves). The top 
plot shows the distance between the reconstructed 7 position and positron position, Ar, the middle plot 
shows the time interval between the 7 and positron. At, and the bottom plot shows the number of hit 
phototubes associated with the 7, N^^its" (Figure and its caption copied from Fig. 10 in Ref. |lj.) 



4 




-1 2 



10 1 10 10 

Fig. 2: "The Rj distribution for events that satisfy the selection criteria for the primary — )• Uc oscilla- 
tion search." (Figure and its caption copied from Fig. 14 in Ref. [ 1 1.) 
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This procedure, while a priori adequate, is criticized below on several accounts. The results 
of the procedure depend on the correctness of the 'base distributions' and the 'efficiencies' 
of correlated and accidental 7's, both not discussed in the LSND papers. A contribution of 
positrons from ^^Ngs beta decays that are interpreted as correlated 7's, has been neglected. 

3 Emulation of the LSND fit of the distribution 

With a view to gaining insight into the salient features of the LSND fit of the distribution by 
an emulation. Table [T] gives the numerical values of the bin contents in the double-logarithmic 
Fig. [2] as obtained by a plot digitization program. 

Table 1: Numerical values of the bin contents in Fig. [2] for the distributions of correlated 7's, acci- 
dental 7's, and of the data including errors. 



R-y 


bin 


Correlated 7's 


Accidental 7's 


Data 


0.050 - 


-0.106 


(50) 


(1902) 


(1932 ± 79) 


0.106- 


-0.226 


1.70 


25.48 


20.54 ±8.65 


0.226 - 


- 0.480 


1.81 


20.10 


6.00 ± 7.63 


0.480 


- 1.02 


2.57 


13.63 


20.98 ± 7.84 


1.02- 


-2.17 


3.19 


9.04 


26.04 ± 7.45 


2.17- 


-4.61 


4.20 


5.87 


10.07 ±5.54 


4.61 - 


-9.80 


5.71 


3.73 


12.50 ±5.45 


9.80- 


-20.8 


7.49 


2.37 


10.07 ±4.85 


20.8- 


-44.3 


8.46 


1.61 


6.00 ±3.89 


44.3- 


-94.1 


9.72 


0.80 


14.23 ± 4.49 


94.1 


-200 


19.70 


0.40 


18.43 ±5.13 



For the size of the bin contents and the logarithmic scale, the contents of the first R^ bin 
(and, if applicable, their errors) cannot be read off precisely. The values used in our fit emulation 
are shown in brackets in Table [1} Thereby, for the two hypothesis distributions use was made of 
the statement that the correlated and accidental 'efficiencies' for R^ > 1 are quoted by LSND 
as 0.51 and 0.012, respectively (Table IX in Ref. [ 1 ]). 

The results for the 'beam excess' from our fits of the data points shown in Fig.[2]are listed in 
Table |2} Fit No. 2, which is our emulation of the LSND fit, gives the result 112.5 ± 21.6 events 
which is to compared with the published LSND result, listed as Fit No. 1, of 117.9±22.4 events. 
In view of the numerical uncertainties of the contents of the first R^ bins, we consider our Fit 
No. 2 a satisfactory emulation of Fit No. 1^\ Fit No. 2 is graphically shown in Fig. [sj 

The first important aspect of our emulation is that it nearly reproduces the total error of 
the 'beam excess' (21.6 w.r.t. to 22.4 published by LSND) by taking into account merely the 
statistical errors of the data points shown in Fig.|2j We recall that the error of 22.4 events was 
used by LSND to calculate the significance of the 'LSND anomaly'. We note that in comparison 
to the statistical error a vanishingly small systematic error has been taken into account by LSND, 
if any. 

^'The (unreadable) error of the first bin does not matter much: the fit resuh of 112.5 ± 21.6 events changes 
to 112.4±21.5 for an error equal to the square root of the bin content, and to 112.8 ± 21.6 for an error three times 
the square root of the bin content. 



6 



in 



LSND data 



Fit of + r; 




-1 -0,5 0,5 1 



1,5 2 



Fig. 3: Emulation of the fit of tlie LSND Ry distribution witli the sum of the hypotheses for correlated 
(hatched) and accidental (open) 7's. 



Table 2: Fits of LSND data shown in Fig. [2] 



Fit No. 


No. of events with corr. 7 




d.o.f. 


Comment 


1 


117.9 ±22.4 (19.0%) 


10.7 


9 


Result published by LSND in Ref. [ 1 ] 


2 


112.5 ±21.6 (19.2%) 


10.8 


9 


Our emulation of the LSND fit 


2a 


116.7 ±22.1 (18.9%) 


10.1 


8 


Fit No. 2 without 1st bin 


3 


103.1 ±20.2 (19.6%) 


11.9 


9 


Ry hypotheses from Fig. 10 in Ref. [6] 


3a 


105.7 ±20.5 (19.4%) 


11.4 


8 


Fit No. 3 without 1st R^ bin 
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The prominent spikes in the first bin of Fig. [2| caused by the 'efficiencies' of correlated 
and uncorrelated 7's, raise questions on respective uncertainties and their effect on the 'beam 
excess' and its error. 

Following LSND's nomenclature, the 'efficiency' of correlated and uncorrelated 7's is de- 
fined as the probability to find a respective 7 that meets three criteria: distance Ar < 250 cm, 
time delay 8 /iS < At < 1 ms with respect to the primary electron, and pulseheight 20 < A^hits < 
60. The numerical values of these efficiencies are, for i?^ > 1, 0.51 for correlated 7's and 0.012 
for accidental 7's, respectively. Both values are quoted by LSND with an error of 7% (Table IX 
inRef. Q). 

First, we show that especially the numerical value of the 'efficiency' of correlated 7's is 
important for the 'beam excess' and its error. 

The content of the first bin consists almost exclusively of events that have no accepted 
delayed 7. Therefore, the content of the first bin does not contribute to the fit's purpose of 
discriminating between correlated and accidental 7's. So why did LSND include the first 
bin into the fit? Omitting the first R^ bin reduces the number of data bins from 11 to 10, and 
reduces the degrees of freedom from 9 to 8, but preserves fully the potential of discriminating 
between correlated and uncorrelated 7's. The result for the 'beam excess' is 116.7±22.1 events 
(Fit No. 3 in Table [2]) where an 'efficiency' of correlated 7's of 0.51 for i?^ > 1 has been 
used. This result which bypasses the reading uncertainty of the data content of the first bin, is 
remarkably close to LSND's result for the bin excess from their 11-bin fit, 117.9 ± 22.4 (Fit 
No. 1 in Table [2]), and proves that our emulation of the LSND fit makes sense. 

Fit No. 3 is graphically shown in Fig.|4} 

Our 10-bin fit sharpens the argument that the LSND fit result comprises little systematic 
error margin, if at all. Already the error of 7% quoted by LSND for the 'efficiency' of correlated 
7's (which will be disputed below) would increase, quadratically added, the 22.1 error of our 
10-bin fit to 23.6 which alone (other systematic errors still ignored) exceeds already the total 
error of 22.4 quoted by LSND. 

As far as the statistical error is concerned, there is no appreciable gain from the inclusion 
into the fit of the data in the first R^ bin. As for the systematic error, while the 7% uncertainty 
of the 'efficiency' of correlated 7's cannot be avoided, the propagation of the 7% systematic 
uncertainty on the 'efficiency' of accidental 7's into the error of the 'beam excess' could be 
avoided. 

While we consider in retrospect a 10-bin fit as the better choice, we limit ourselves in the 
further discussion to the 11-bin fit since this type of fit was LSND's choice and underlies the 
'LSND anomaly'. 

The 'efficiencies' are in an 1 1-bin fit an integral part of the two hypothesis distributions for 
correlated and uncorrelated 7's. The numerical values of the 'efficiencies', in particular the one 
of correlated 7's, have a direct impact on the 'beam excess' and its error. 

Where do the 'efficiency' values and their errors come from? Can the values quoted by 
LSND be understood? It is surprising that the values are quoted in LSND's final physics paper 
(Table IX in Ref. [[T|), however, nowhere in this paper is their origin discussed. The only hint 
can be found in an earlier paper that quotes intermediate results (Section III.F in Ref. [6]): "The 
efficiency for producing and detecting a 2.2 MeV correlated 7 within 2.5 m, with 21-50 PMT 
hits, and within 1 ms was determined to be 63 ± 4% using the solid curve of Fig. 5. This 
efficiency is the product of the probability that the 7 trigger is not vetoed by a veto shield signal 
within the previous 15.2 /xs (82 ± 1%), the data acquisition livetime (94 ± 3%, lower for 7's 
than for primary events), the requirement that the 7 occurs between 8 /US and 1000 /is after the 



8 



LSND data 

Fit of R;"" + 
m corn 7 




-1 -0.5 0.5 1 1.5 2 

logio (Rr) 



c 

> 10*^ 
0) 



10 



Fig. 4: 10-bin fit of the LSND distribution with the sum of the hypotheses for correlated (hatched) 
and accidental (open) 7's. 
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primary event (95 ± 1%), the requirement that the 7 has between 21 and 50 hit PMTs (90 ±4%), 
and the requirement that the 7 reconstructs within 2.5 m of the primary event (96 ± 2%)". From 
this we can conclude that the efficiency for correlated 7's stated in LSND's final physics paper, 
0.51 (±7%) for R-y > 1, is in part determined by data acquisition properties, and in part by the 
'base distributions' of Ar, At and A^hits- 

While we must assume that the data acquisition properties such as livetime, and experi- 
mental conditions such as the rate of accidental 7's, were understood and correctly taken into 
account, we shall dispute below some of the 'base distributions' and their impact on the 'effi- 
ciencies'. 

4 On uncertainties of the 'base distributions' 

In this section, we shall assess systematic uncertainties of the 'base distributions' that were 
published by LSND [ 1 1 and reproduced in Fig. [T] 

Why did LSND publish smooth functions in their final physics paper [[TJ and not data and 
Monte Carlo distributions, respectively, as they did in their earlier paper on intermediate re- 
sults [[6)? This question is the more appropriate as there are interesting differences between the 
two presentations, not discussed by LSND anywhere in their papers, to which we shall return 
below. 

We note also that systematic uncertainties of the 'base distributions' are nowhere discussed 
in LSND papers. 

Our discussion will concentrate on LSND's final base distributions since these were claimed 
to underlie their final results. We note that the distributions shown in Fig.[T]are computer-drawn 
functions. We have reproduced the LSND 'base distributions' with a plot digitization program. 
They are referred to below as HARP-CDP 'base distributions' and used to emulate the Rj fit 
hypotheses for correlated and accidental 7's. 

4.1 The At 'base distributions' 

At is the time delay between the primary electron and the subsequent correlated or accidental 7. 
The At 'base distributions' for 8 /US < At < 1 ms are uncontroversial, and so are the pertinent 
contributions to the 'efficiencies' of correlated and accidental 7's. 

The At distribution of accidental 7's is flat since we understand that any number of 7's was 
recorded that fell into the window 8 /iS < At < 1 ms (the choice of the one with the largest R^ 
among them does not depend on At). Because of this requirement — that is nowhere discussed 
in the LSND papers — , it would have been worthwhile to demonstrate experimentally that the 
At distribution of accidental 7's was indeed flat. 

The At distribution of correlated 7's is claimed by LSND as exponentially falling with 
a mean time delay of 186 jj,s. We checked the latter with a Monte Carlo program that tracks 
1 MeV neutrons (the average energy of neutrons released in the signal reaction z/c + p — )• e"*" -1- n) 
from creation until capture by a free proton in the LSND detector^^ Salient results are shown 
in Figs. |5]and[6j The average time to reach the epithermal energy of 10 keV is 16.0 ns and 
hence negligibly small in comparison to the average time of 15.0 /iS to reach the thermal energy 
of 0.022 eV. The bulk of the time is spent between subsequent elastic scatterings at thermal 
energy. We find the time delay distribution until capture exponentially falling with an average 
of 196.1 /iS, slightly larger than 186 yus. 

are indebted to K. Niinighoff from the Forschungszentrum Jiilich GmbH for making available to us an 
extensive compilation of neutron cross-sections on free protons. 



10 



1 MeV neutron 

At at 10 keV energy 




10 20 30 40 50 60 70 80 90 100 

At [ns] 



Fig. 5: Distribution of time delays between the creation in the LSND scintillator medium of a 1 MeV 
neutron and the transition to the epithermal energy of 10 keV. 



This time delay solely depends on the average speed of a thermal neutron and its capture 
cross-section. At thermal energy level, the hydrogen atoms in the LSND detector medium, 
mineral oil, are not free but bound which increases the capture cross-section with respect to 
the one for free hydrogen atoms. This increase — which entails a decrease of the average time 
delay — depends on the energy levels of vibrational states of the hydrogen atom in the mineral 
oil molecule and is hard to estimate. LSND do not state where their expectation of 186 fis 
comes from, but they state in an earlier paper that they measured the average time delay as 
188 ±3 fis (Section lll.B and Fig. 1 in Ref. [[6)) with cosmic-ray neutrons. This is possible since 
the neutron's At distribution is nearly independent of the initial neutron energy (other than the 
neutron's Ar distribution, discussed below). We acknowledge this measurement, conclude that 
the hydrogen atom in mineral oil is quasi- free, and use LSND's average time delay of 186 /xs in 
our analysis. 

4.2 The Ar 'base distributions' 

Other than LSND's At 'base distributions', their Ar 'base distributions' cause major concerns. 

In an infinite medium, the Ar distribution of accidental 7's should smoothly rise with (Ar)^. 
In the finite fiducial volume of the LSND detector, the actual distribution must fall below this 
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Fig. 6: Distribution of time delays between the creation in the LSND scintillator medium of a 1 MeV 
neutron and its capture on a free proton. 
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Fig. 7: Normalized distributions of the distance Ar for accidental 7's: as published by LSND (full line), 
and a variant (dotted Une). 



functional dependence, especially at large Ar. Indeed, this is seen in Fig. 2 in Ref. [l6l which 
shows measured data, but is not seen in Fig. 10 in LSND's final physics paper [ 1 1 (reproduced 
here in Fig.[T]) which shows not the experimental data but a parametrization obtained from a fit to 
experimental data. We consider that at large Ar LSND's parametrization of the Ar distribution 
of accidental 7's is unphysical. 

There is a second reason why LSND's final Ar distribution of accidental 7's cannot be 
quite right: the 'hot spot' of radioactivity in the upstream bottom portion of the LSND detector, 
prominently visible in Fig. 3 in Ref. [[6| and discussed there in Section III.D.2. Yet there is no 
mention of this 'hot spot' in LSND's final physics paper [[T|. 

LSND's Ar distribution for accidental 7's is compared in Fig. |7] with a variant that we 
consider equally likely to represent the situation. 

The Ar distribution for accidental 7's is rather insensitive to the spatial resolution of the 
reconstructed position of the accidental 7. The variant shown in Fig.|7]has been generated with 
a spatial resolution of cr = 35 cm. 

The Ar distribution of accidental 7's could experimentally be well determined by recording 
7-compatible events in randomly opened gates, and calculating Ar w.r.t. a randomly chosen 
location within the fiducial volume. It would have been worthwhile to present the result in 
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LSND's final physics paper. 

The cut Ar < 250 cm that contributes to the 'efficiency' of accidental 7's will have a 
different effect for the two distributions shown in Fig. [7} 

Now we turn to the Ar distribution of correlated 7's. This distribution stems from a convolu- 
tion of (i) the distribution of the distance of the neutron emitted in the reaction z/c + p — )• e"*" + n 
between its point of creation and its point of capture, (ii) the spatial resolution of the recon- 
structed point of creation, and (iii) the spatial resolution of the reconstructed position of the 
2.2 MeV 7. 

Our result on the first of these three distributions is shown in Fig. [8] The average Ar 
between the point of creation of a 1 MeV neutron and the point of its capture is 1 1 .4 cm. This is 
consistent with expectation from neutron diffusion theory which stipulates that thermal neutrons 
are captured at an average distance of 2y/Ddis ■ Aabs ~ 4.7 cm, were D^m = 0.144 cm is the 
neutron diffusion coefficient and Aabs = 38.4 cm is the mean free path in mineral oil. While 
these numbers hold in the limit of free protons, we recall our conclusion from Section 4. 1 that 
the hydrogen atom in mineral oil is quasi-free. The increase from 4.7 cm to 1 1 .4 cm stems 
from the neutron's movement during slowing down from 1 MeV kinetic energy to the average 
thermal energy of 0.022 eV. We note that there is no discussion in the LSND papers of the 
distribution of the distance Ar of the neutron between creation and capture. 

The point of neutron creation is reconstructed as the position of the primary electron. LSND 
state the average spatial resolution as 14 cm (Section lI.E in Ref. [1]). 

The spatial resolution of 2.2 MeV 7's is recognized to be important by LSND, however 
they do not specify the resolution. The only statement that can be found reads as "the most 
likely distance was reduced from 74 cm [with a previous reconstruction algorithm] to 55 cm" 
(Section IV in Ref. [[T|). A peak position of 55 cm suggests a spatial resolution of approximately 
35 cm when taking the said convolution into account. This is considerably smaller than the 
estimate of 54 cm which is 14 cm multiplied by a/33/2.2, where 33 MeV is the average primary 
electron energy above the threshold of 20 MeV. So there is quite some uncertainty on the spatial 
resolution of 2.2 MeV 7's. 

We note that all three distributions that are convoluted into the Ar distribution of correlated 
7's, come from Monte Carlo simulation and cannot be verified by data in an unbiased manner. 
In particular, cosmic -ray neutrons have much higher energy and bias Ar towards larger values 
by virtue of the decreasing scattering cross-section above 1 MeV energy. For the 2.2 MeV 
photons from the capture of cosmic-ray neutrons, there is no unbiased reference point for the 
calculation of Ar. 

We compare in Fig. |9]the Ar distribution claimed by LSND with with a variant that we 
consider equally likely to represent the situation. 

As both the LSND Ar distribution for correlated 7's and our respective distribution tend 
toward zero at large Ar, the cut Ar < 250 cm will not cause much difference on the 'efficiency' 
of correlated 7's. 



4.3 The A^hits 'base distributions' 

While the Ar distributions of correlated and accidental 7's cause major concerns, the A'hits 
distributions cause minor concerns. This is because the pertinent A^hits distribution can be ex- 
perimentally verified with high statistical precision from the measurement of 2.2 MeV 7's from 
the capture of cosmic-ray neutrons^\ and from the measurement of accidental 7's in randomly 

^'Clean samples of 2.2 MeV 7's from neutron capture could be ascertained through the observation of an expo- 
nentially falling At distribution with an average of 186 /is. 
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Fig. 8: Distribution of distances between the point of creation in the LSND scintillator medium of a 
1 MeV neutron and the point of capture on a free proton. 
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Fig. 9: Normalized distributions of the distance Ar for correlated 7's: as published by LSND (full line), 
and a variant (dotted Une). 
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Fig. 10: Normalized distributions of the number of hit PMTs, A'^hits. for accidental 7's: as published by 
LSND (fuU line), and a variant (dotted line). 




opened gates during beam-off times. 

LSND state that accidental 7's arise from "radioactivity". We note that that there are small 
contributions from misidentified electrons from ^^B and positrons from ^^Ngs beta decays which 
both exhibit a A^hits spectrum that is quite different from the A^hits spectrum from radioactivity. 
This is well visible in the respective measured spectrum shown in Fig. 2 in Ref. [1|, however, 
the tail toward large A^hits that is expected and well visible there, is absent in Fig. [T] taken from 
the final LSND physics paper [1|. Another concern is the shape of the spectrum toward small 
A^hits which is dominated by a strong non-linearity of the readout electronics^^ and hence quite 
vulnerable to even small drifts of the electronics which are unavoidable over six years of data 
taking. 



LSND's A^hits distribution for accidental 7's is compared in Fig. 10 with a variant that we 
consider equally likely to represent the situation. Analogously, Fig. [TT shows the situation for 
correlated 7's. 

We note that the lower cutoff of 21 A^hits bears on the 'efficiencies' of correlated and even 
more of accidental 7's. 



^^We note the stark conflict between the calibration 21 PMT hits = 0.7 MeV stated in Section II. F in Ref. |[l), 
and 34 PMT hits = 2.2 MeV read off from Fig. [T] 
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Fig. 11: Normalized distributions of the number of hit PMTs, N-^^g, for correlated 7's: as pubUshed by 
LSND (full line), and a variant (dotted line). 
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5 On the 'efficiencies' of correlated and accidental 7'S 

As pointed out already above, the numerical values and the uncertainties of the 'efficiencies' 
of correlated and accidental 7's are important ingredients to the fit of the i?^ distribution that 
yields the 'beam excess'. After we assessed the 'base distributions' and discussed their impact 
on the 'efficiencies', we can give our numerical estimates, which are summarized and compared 
with the respective values quoted by LSND [jT] in Table |3j 



Table 3: Our estimate of the 'efficiencies' of correlated and accidental 7's 





Correlated 7's Accidental 7's 


No veto signal 

Data acquisition alive 


0.82 (±1%) 
0.94 (±3%) 


Ar < 250 cm 
8 ;us < At < 1 ms 

21 < A^hits < 60 


0.98 (±2%) 
0.95 (±1%) 
0.94 (±2%) 


0.23 (±4%) 
0.63 (±?%) 
0.85 (±5%) 


Overall 'efficiency' for > 

(R^ > 1) / (R^ > 0) 

Overall 'efficiency' for R^ > 1 


0.67 (±4%) 

0.93 
0.63 (±4%) 


0.095 (> ±7%) 

0.072 
0.0068 (> ±7%) 


LSND's 'efficiency' for i?^ > 1 


0.51 (±7%) 


0.012 (±7%) 



Several comments are in order. First, the stated 'efficiencies' from the signal veto and data 
acquisition livetime are not stated in LSND's final physics paper [ 1 1 but are taken from an earlier 
paper that gave intermediate results (Section III.F in Ref. [6]), and hence may not be correct 
averages for the full data set. Second, our estimated 'efficiency' of correlated 7's for i?^ > 1 
of 0.63 (±4%) does not compare well with LSND's which is 0.51 (±7%). This is important as 
the 'beam excess' is directly proportional to the reciprocal value of this 'efficiency'. Third, an 
important information is missing in LSND's final physics paper |1| which is the average rate of 
accidental 7's over the entire data taking which directly bears on the efficiency of observing at 
least one accidental 7 in the window 8 /is < At < 1 ms. The only pertinent information is found 
in an earlier paper that gave intermediate results where it is stated "The average accidental 7 rate 
over the entire detector is 1.07±0.01kHz in 1993, 1.19±0.01 kHz in 1994, and 1.14±0.01kHz 
in 1995" (Section III.D.2 in Ref. [[6|). We used an average accidental rate after deadtime of 
1 kHz which leads to the respective 'efficiency' of 0.63 quoted in Table [3] for the window 8 fis 
< At < 1 ms. We have no explanation why our estimate of the overall 'efficiency' for Rj > 1 
ofO.0068 (> ±7%) is nearly afactoroftwo below LSND'sestimate of 0.012 (±7%). We recall 
in this context that the 'efficiencies' and their uncertainties are quoted but not explained in any 
way in LSND's final physics paper [ 1 ], despite their importance. 

While we are concerned about these inconsistencies, for lack of published information on 
details of the LSND experiment we cannot insist on our estimates of 'efficiencies'. Hence we 
shall use in the further discussion the values and uncertainties quoted by LSND. 

6 Positrons from ^^Ngs beta decays 

By virtue of its construction, the LSND detector could only measure the position and time of an 
energy deposit, but could not determine whether the deposit originates from a charged or from 
a neutral particle. 
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In the same way as electrons from (accidental) beta decays of B nuclei — activated by the 
capture of cosmic-ray /i~ by ^^C nuclei — contribute to uncorrelated 7's, positrons from the 
abundant beta decay of ^^Ngg nuclei originating from the inverse beta decay reaction + ^^C 

e^ + ^^Ngs can contribute to beam-related 7's. 

Because of the threshold energy of 17.86 MeV for the reaction z/g ^^C — >■ e~ ^^N and the 
trigger requirement of a minimum electron energy of 20 MeV, only above 37.86 MeV will 
contribute to background. 

The beta decay ^^Ngs — t- ^^C e+ proceeds with -Emax = 16.316 MeV and a lifetime of 
15.87 ms 0. 

Some positrons will fake a 7 from neutron capture. The fraction of positrons with accepted 
energy between 21 and 60 PMT hits (corresponding to an energy calibration of 34 PMT hits = 
2.2 MeV read off from Fig.[T]), is calculated to be 0.068 (for the calculation of this fraction, the 
addition of 1 .022 MeV from positron annihilation and the energy resolution have been taken 
into account). The window 8 /iS < At < 1 ms selects a fraction of 0.061 of the positrons. 

Altogether, we estimate that 2.7 positrons meet the acceptance criteria of a 7 from neutron 
capture, with an estimated 'efficiency' (defined analogously to the 'efficiency' of 7's) of 0.58. 
Their Ar, At and A^hits distributions resemble more closely the ones of correlated 7's rather than 
the ones of accidental 7's. Therefore, misidentified positrons from ^^Ngs beta decays constitute 
a small but non-negligible background. 

This background of misidentified positrons from ^^Ngg beta decays is not considered in the 
LSND analysis. 

7 PSEUDODATA in lieu OF LSND DATA 
7.1 The methodology 

The LSND analysis rests on the following concept. Each accepted primary electron candidate 
is entered into the plot where i?^ is calculated by the algorithm from the observed triplet 
[Ar, At, A^hits] of the associated 7 as the ratio of the likelihoods that this triplet stems from a 
correlated 7 and from an accidental 7, respectively. The i?^ algorithm makes use of the 'base 
distributions'. The distribution of the -R^'s represent the data. The same R^ algorithm is also 
used to calculate the R^ distributions of correlated and accidental 7's, i.e., of 7's of the two 
possible origins. Both the R^ distributions of correlated and accidental 7's are normalized to 
unity, their linear combination constitutes the fit hypothesis. Out of the two fit parameters, the 
coefficient of the correlated i?^ distribution is the wanted 'beam excess'. 

There is no reason to believe that the 'base distributions' are error-free. Rather, they can 
vary within bands of systematic uncertainty. LSND did not publish a study of the systematic 
error of the 'beam excess', they quoted its error without commenting on the origin. The usual 
way of studying the systematic error of the 'beam excess' that stems from uncertainties of 
the 'base distributions' would have been the following. Starting from their observed triplets 
[Ar, At, A^hits], they could have varied the 'base distributions' used in the i?^ algorithm. This 
would have produced variants of both the R^ distribution of the data and the R^ distributions 
of correlated and accidental 7's. They would have noticed both changes of the 'beam excess' 
and changes of its error (it being understood that 'error' refers to the correlated error, i.e., the 
correlation between fit parameters is duly taken into account). 

While this should have been done by LSND but was apparently not — there is no pertinent 
mention in their papers — , we cannot do that since we have no access to the observed triplets 
[Ar, At, A^hits] . Therefore, we turn things around. First, we generate pseudodata with variants 
of 'base distributions'. Then, we calculate with an R-y algorithm that makes use of one and 
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only one set of 'base distributions', namely the HARP-CDP 'base distributions', both the 
distribution of the pseudodata and the fit hypothesis, i.e., the linear combination of the normal- 
ized distributions of correlated and accidental 7's. We recall that the HARP-CDP 'base 
distributions' reproduce the 'base distributions' published by LSND and shown in Fig.[T} For 
each variant of the 'base distributions', we observe a change of the 'beam excess' and a change 
of its error when we compare with the default situation: the pseudodata are generated with the 
same set of HARP-CDP 'base distributions' that the R-^ algorithm uses to calculate the i?^ dis- 
tribution of the pseudodata and of the normalized R^ distributions of correlated and accidental 
7's. 

The observed variation of the 'beam excess' that stems from the use of variants of the 'base 
distributions' for the generation of pseudodata is used to obtain an estimate of its systematic 
error. 

We draw attention to a peculiar correlation that is inherent in the LSND analysis procedure. 
The very same R^ algorithm is used to calculate the R^ distribution of the data and of the nor- 
malized i?^ distributions of correlated and accidental 7's. That has the following consequence. 
If the R^ algorithm makes use of different 'base distributions', both the data and the fit hypoth- 
esis change coherently. This manifests itself in a change of the error of the 'beam excess' by 
virtue of a change of the correlation coefficient of the two fit parameters (the i?^ distributions 
of correlated and uncorrrelated 7's become more similar or dissimilar). With a view to high- 
lighting this aspect, we list in later pseudodata fits in addition to the best-fit value of the 'beam 
excess' and its correlated error also the correlation coefficient. We make no further use of this 
aspect in our estimate of the systematic error of the 'beam excess', though. 

A problem in our procedure is caused by the presence of accidental 7's that occur with a rate 
that is rather uncertain. Since in the case of more than one accepted 7 the one with the largest 
R^ is taken, a correct generation of pseudodata depends on the effective rate of accidental 7's 
after data acquisition losses — an information that is not given by LSND. Along the lines of the 
pertinent discussion in Section|5} we assume an effective rate (i.e., after data acquisition losses) 
of accidental 7's of 1 kHz and assign a ±20% error. 

The event numbers and errors of the pseudodata orient themselves on the respective LSND 
event numbers and errors as listed in Table [T] The errors of the pseudodata are forced to be 

— LSND data error 

. pseudodata events ■ = 

VNo. LSND events 

The pseudodata represent expectation values, no fluctuations from errors are imposed. Thereby, 
systematic shifts of the 'beam excess' in different sets of pseudodata are not hidden by statisti- 
cal variations. This permits to demonstrate even small systematic changes of the 'beam excess' 
when input assumptions are varied within uncertainty bounds. 

The discussion of changes of the 'beam excess' must occur against a reference point. Closely 
following LSND's beam excess of 117.9 events, we chose the round number of 120 events. 

Therefore, our 'reference' pseudodata consist of 

- 120 events with the R^ distribution of correlated 7's derived from the HARP-CDP 'base 
distributions' and with LSND's nominal 'efficiency' for i?^ > 1 of 0.51, or suitable 
variants; 

- 1980 events with the R^ distribution of accidental 7's derived from the HARP-CDP 'base 
distributions' and with LSND's nominal 'efficiency' for i?^ > 1 of 0.012, or suitable 
variants; and 
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- (optionally) 2.7 events with the distribution of positrons from ^^Ngs beta decays (that 
will be graphically shown below), with an estimated 'efficiency' of 0.58. 

Before presenting results of fits of pseudodata with varying assumptions, we discuss some 
details of the HARP-CDP Ry 'reference' distributions that we used. 

Figure 12 shows the R^ hypotheses for correlated and for accidental 7's used in the LSND 
analysis and compares them with the respective HARP-CDP R^ hypotheses. We recall that the 
HARP-CDP Ry hypotheses stem from the LSND 'base distributions' shown in Fig. [T| modi- 
fied to take accidental 7's with a rate of 1 kHz into account (the size of this modification will 
be graphically shown below), and taking the LSND 'efficiencies' of 0.51 and 0.012, respec- 
tively, for correlated and accidental 7's into account. Therefore, the HARP-CDP R^ hypothe- 
ses should be identical to the LSND R^ hypotheses. They are not. The effect of the difference 
for the 'beam excess' is shown in Table [2] where we present the results of both an 11-bin (Fit 
No. 3) and a 10-bin fit (Fit No. 3a), with a view to eliminating concerns from the bin contents 
and error of the first Ry bin. 

The 'beam excess' of 103.1 ± 20.2 events from the 11-bin fit is considerably lower than 
LSND's 'beam excess' of 117.9 ± 22.4 (cf. Table[2]). The discrepancy is not caused by uncer- 
tainties of the bin contents or a data error of the first R^ bin since the 10-bin fit gives nearly 
the same result. Rather, the discrepancy proves an inconsistency in the LSND analysis: the R^ 
hypotheses used by LSND in the fit of their data and shown in Fig. [2] are not congruent with 
those derived from LSND's 'base distributions' shown in Fig.[T| although LSND's final physics 
paper [1] claims they are. 

We note this discrepancy which has a large effect on the 'beam excess' . However, there may 
well be intrinsic features of the LSND analysis (such as possible averaging over different 'base 
distributions' at different periods of data taking — albeit not discussed anywhere in the LSND 
papers — ) that we are not aware of. Therefore, we do not make any use of this discrepancy. 

The problem of observing more than one 7 within the window 8 /xs < At < 1 ms was 
already addressed. Because of LSND's choice that in case of more than one 7 being observed, 
the one with the largest R^ is used, the R-y distribution is altered depending on the rate of 
accidental 7's. While LSND do not discuss this issue at all, we show in Fig. 13 the HARP- 
CDP Ry hypotheses for correlated and accidental 7's with and without accidental 7's at an 
effective rate of 1 kHz added. The difference is visible and its effect on the 'beam excess' will 
be discussed in Section l7?2l 

Next, Fig. 14 shows a comparison of the normalized HARP-CDP R^ distributions of cor- 
related and uncorrelated 7's, and of the i?^ distribution stemming from misidentified positrons 
from ^^Ngs beta decays. The latter is closer to the R-y distribution of correlated 7's than the 
one for accidental 7's which will have the consequence that the bulk of this background will be 
misinterpreted as 'beam excess', if not duly subtracted. 

Now we have all ingredients to show the 'reference' Rj distribution of the HARP-CDP 
pseudodata, and to compare it with the R^ distribution of the LSND data. This comparison is 
shown in Fig. 15 The LSND distribution is a graphical representation of the numbers listed in 
Table [H 

We must demonstrate the consistency of our approach: the fit of the 'reference' R^ dis- 
tribution of the HARP-CDP pseudodata with the HARP-CDP R^ hypotheses must return the 
input beam excess of 120 events. This expectation is met: the respective fit result is numerically 
presented in Table |4] and graphically shown in Fig. [76} 

Fit No. 6 employs R^ hypotheses not modified by the inclusion of accidental 7's with an 
effective rate of 1 kHz. This fit is motivated by the observation that LSND do not discuss this 
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Fig. 12: The normalized LSND i?.y hypotheses (full lines) for correlated (upper panel) and accidental 
(lower panel) 7's, compared with the respective normalized HARP-CDP hypotheses (broken lines); 
the former are a graphical representation (duly normalized) of the numbers listed in Table [TJ as for way 
the latter were obtained, see the text. 
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Fig. 13: The normalized HARP-CDP Ity hypotheses for correlated (upper panel) and accidental (lower 
panel) 7's with accidental 7's at an effective rate of 1 kHz added (full lines), and without (broken lines). 
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Fig. 14: Comparison of the normalized HARP-CDP distributions of correlated and uncorrelated 7's, 
and of the R3 distribution stemming from misidentified positrons from ^^Ngg beta decays. 



Table 4: Selected fits of pseudodata 



Fit No. 


No. of events with corr. 7 


corr. coeff. 


Comment 


5 


120.2 ±21.9 


-0.165 


Fit of 'reference' pseudodata 


5a 


120.2 ±22.6 


-0.256 


Fit No. 5 without 1st bin 


6 


126.3 ±22.0 


-0.156 


'Base distributions' not modified by acc. 7's 


31 


122.5 ±22.1 


-0.165 


includes 2.7 positrons from ^^Ngg 
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Fig. 15: Comparison of the 'reference' Hy distribution of the HARP-CDP pseudodata (upper panel) 
with the iiy distribution of the LSND data. 
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Fig. 16: Fit of the pseudodata Ry distribution with the sum of the hypotheses for correlated (hatched) 
and accidental (open) 7's. 
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important modification altliough in our view the inclusion is mandatory. 'Base distributions', 
by construction, do not include accidental 7's. The i?^ distribution of the data and pseudodata, 
respectively, does. Hence the hypotheses must, too. Fit No. 6 shows that the non-inclusion 
of accidental 7's would produce a larger 'beam excess' by some 6 events. However, since we 
have no evidence that LSND did not include properly the observed effective rate of accidental 
7's, no further use is made of the result of Fit No. 6. 

Fit No. 31 adds to the pseudodata 2.7 positrons from ^^Ngs along the lines of the discussion 
in Section [6| with the pertinent distribution. The fit hypotheses comprise only correlated 
and accidental 7's. Since the Rj3 distribution is much closer to the distribution of correlated 
7's than the one of accidental 7's, 2.3 events out of the 2.7 events are interpreted as correlated 
7's which means that LSND's fit result for the 'beam excess' has a background of 2.3 events 
that was not subtracted. 

7.2 Pseudodata fit results 

In Table |5} we present the results of fits of pseudodata sets that we selected as most representa- 
tive out of a large variety that we studied, and that we used to derive our error estimates. 

Fit numbers with 'a' and 'b' refer to a pair of fits where a parameter was varied symmetri- 
cally up and down. 

The 'beam excess' is given together with the correlated statistical error that reflects the input 
errors of the l \ R^ bins of the respective pseudodata. 

In the case of pairs of fits, labelled 'a' and 'b' in Table [5| systematic errors are listed only 
for the latter to avoid double counting. Systematic errors are calculated from the changes of the 
'beam excess' with respect to the best-fit value of the 'reference' pseudodata Fit No. 5, 120.2 
events (see Table |4]). In the case of Fit No.s 32a and 32b, the systematic error is calculated 
from the changes of the 'beam excess' with respect to the best-fit value including the ^^Ngs 
background, 122.5 events (see Fit No. 31 in Table |4]). 

Overall errors are obtained by quadratic addition of the errors shown in Table |5] The statisti- 
cal error of 2 1 .9 events of the 'reference' pseudodata Fit No. 5 leads together with the systematic 
error of 17.3 events to a total error of the 'beam excess' of 27.9 events. 

At the same time, a subtraction of 2.3 primary electrons with positrons from ^^Ngs beta 
decays that are misidentified as correlated 7 from neutron capture, reduces the LSND 'beam 
excess' from 117.9 to 115.6 events. 

Table[6]compares the main results of the LSND analysis with our assessment of the situation, 
discussed in the preceding paper Q and in this paper. Our conclusion is that the significance 
of the 'LSND anomaly' is not 3.8 a but 2.3 a, or rather — in view of further concerns that were 
put forth at several occasions but not quantitatively followed up — not larger than 2.3 a. 

8 Conclusion 

A summary of our concerns about the published results from the LSND experiment reads as 
follows. The first major concern is the underestimation of the standard Vf. flux which is caused 
by (i) inadequate knowledge of tt^ production by 800 MeV/c protons on various target nuclei, 
at the time when the LSND experiment was conducted, and (ii) from not taking into account vr" 
production by neutrons. Both effects are quantitatively discussed in our preceding paper [Q. 
The second major concern is what we consider shortcomings in the LSND data analysis, dis- 
cussed in this paper: questions on the 'efficiencies' of correlated and accidental 7's; questions 
on the effective rate of accidental 7's and their influence on the R^ hypotheses for correlated and 
accidental 7's; missing positrons from ^^Ngs beta decays that are misidentified as correlated 7's; 
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Table 5: Results of fits of selected pseudodata sets 



Fit No. 
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positrons down by 30% 


36a 


122 5 ± 22 1 


-0.164 




acc ^ rate 1 2 kHz 


36b 


118.1 ±21.8 


-0.166 


2.2 


acc. 7 rate 0.8 kHz 


41a 


134.0 ±23.2 


-0.175 




spatial 7 resolution cr = 35 cm 


41b 


112.7±21.1 


-0.157 


11.1 


spatial 7 resolution c = 45 cm 


53 


127.9 ±22.4 


-0.163 


7.6 


slower rise of Ar of acc. 7's 


61 


122.1 ±22.0 


-0.164 


1.9 


large A^hits of acc. 7's up 


72a 


125.4 ±22.3 


-0.165 




small iVhits of 7's down 


72b 


113.5 ±21.5 


-0.164 


6.0 


small A^hits of 7's up 








17.3 





Table 6: The 'LSND anomaly' and its significance 





LSND published 


This paper's analysis 


'Beam excess' 


117.9 ±22.4 


115.6 ±27.9 


Background 1 


19.5 ±3.9 


30.6 ±8.8 


Background 11 


10.5 ±4.6 


13.8 ±8.2 


'LSND anomaly' 
Significance 


87.9 ±23.2 
3.8(7 


71.2 ±30.4 
2.3(7 



and missing systematic errors of the 'base distributions'. Our conclusion is that the significance 
of the 'LSND anomaly' is not 3.8 a but not larger than 2.3 a. 
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